Using Games to Create Language Resources: Successes and Limitations of the Approach

One of the more novel approaches to collaboratively creating language resources in recent years is to use online games to collect and validate data. The most significant challenges collaborative systems face are how to train users with the necessary expertise and how to encourage participation on a scale required to produce high quality data comparable with data produced by “traditional” experts. In this chapter we provide a brief overview of collaborative creation and the different approaches that have been used to create language resources, before analysing games used for this purpose. We discuss some key issues in using a gaming approach, including task design, player motivation and data quality, and compare the costs of each approach in terms of development, distribution and ongoing administration. In conclusion, we summarise the benefits and limitations of using a gaming approach to resource creation and suggest key considerations for evaluating its utility in different research scenarios. Jon Chamberlain University of Essex, Wivenhoe Park, Colchester CO4 3SQ, England, e-mail: [email protected] Karën Fort INIST-CNRS / LIPN, 2, allée de Brabois, 54500 Vandoeuvre-lès-Nancy, France, e-mail: [email protected] Udo Kruschwitz University of Essex, Wivenhoe Park, Colchester CO4 3SQ, England, e-mail: [email protected] Mathieu Lafourcade LIRMM, UMR 5506 CC 477, 161 rue Ada, 34392 Montpellier Cedex 5, France e-mail: [email protected] Massimo Poesio University of Essex, Wivenhoe Park, Colchester CO4 3SQ, England, e-mail: [email protected]